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ABSTRACT 

Certain aptitude and personality tests were given to the 1964 
Management Curriculum military officer students of the U. S. Naval 
Postgraduate School and the scores were correlated with the academic 
grades received during the first three terms. The results obtained 
confirm that the Graduate Record Examination is an excellent predictor 
of academic performance and indicate that neither the Structured 
Objective Rorschach Test or Allport-Vernon-Lindzey Study of Values are 
useful predictors of academic performance in the Management Curriculum. 
It is recommended that the Graduate Record Examination be administered 
to candidates for the Management Curriculum and that Selection Boards 
be advised of the results to assist in student selection for future 


classes. 
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CHAPTER I 
STATEMENT OF THE PROBLEM 
During the preceding three years, studies have been conducted 
dealing with coefficients of correlation derived by comparing certain 
aptitude test scores with academic performance of the students in the 
Management Curriculum at the U. S. Naval Postgraduate School, Monterey, 
California. This paper may be considered as the fourth in the series 
of these correlation studies. 
I. THE PROBLEM 
This research study was undertaken to assess the characteristics of 
the 1964 Management Curriculum class by means of certain aptitude and 
personality tests and to determine if these tests offer a means of im- 
proving the selection of candidates for the Management Curriculum. 
II. DEFINITION OF KEY TERMS 
Aptitude Tests are tests which are designed to predict ability to learn 
in a specific area. 
Personality Tests are tests which attempt to assess an individual's basic 
interests or personality characteristics. 
Quality Point Rating (QPR) refers to a student's weighted grade score 
computed from standards established by the Naval Postgraduate School 


Staff as follows: 


Performance Grade Quality Point Number 
Excellent A 3.0 
Good B 2.0 
Fair C 1.0 





Barely Passing D O20 
Failure | X -1.0 
Multiplying the term hour value of a course by the quality point 
number received provides the total quality points for that course. Add- 
ing the quality points for all courses and dividing by the total number 
of credit hours results in a figure defined as the quality point rating. 
For example, if a student received four hours of A and four hours of 5, 
his quality point rating would be 2.50 (4x%3+4+ 4x 2) + 8 hours 
Master's Level Academic Performance. To be eligible for a degree of 
Master of Science in Management, a student must attain a minimum average 
QPR of 2.00 in postgraduate level courses. 
Graduate Record Examination (GRE) is a nationally accepted paper and 
pencil aptitude test designed to predict academic potential at the 
graduate level. 
Structured Objective Rorschach Test (SORT) is a forced response paper 
and pencil projective ink blot personality test which is designed to 
appraise vocationally significant temperament traits. 
AVL - Study of Values is a paper and pencil personality test which is 
designed to measure the relative prominence of six basic interests, 
Local Questionnaire is a questionnaire which was formulated by the 
authors of this paper for the purpose of ascertaining the general 
interest of Management students in the curriculum both before and after 
commencing the course. 
Correlation Coefficient is a measure of the degree of relationship be- 
tween two or more variables, or, in other words, the degree to which 


variables or measures vary together. Mathematically, the value may 








range from a perfect positive correlation (+1.0) through no relation- 
ship (0.0) to a perfect negative correlation (-1.0). When correlating 
variables, the coefficients indicate roughly the following strengths of 


relationships between the variables: 


frecs than .20 ..... ».-Slight, almost negligible relationship 
m0 = @40. ..05% ..-Low correlation, definite but slight relationship 
BHU = 670” sete ..-Moderate correlation, substantial relationship 
.70 - .90 ........High correlation, marked relationship 


.90 - 1.00 .......Very high correlation, very dependeable relationship 
Those who employ tests in guidance and selection consider that a 
correlation coefficient should be at least .45 for material usefulness 
and that best results are obtained when the coefficient is above oe 
Reliability Coefficient is a measure of the repeatability of the test 
results. It is obtained by correlating the test with itself to determine 
the degree of similarity of results if the test is retaken in the same or 
alternate form or by splitting the test into halves. A reliability co- 
efficient of at least .80 is desirable for a test to be considered re- 
Mianile 
Confidence Level as used in this paper is 95 percent and is the probability 
that the true correlation coefficient for the entire population lies with- 


in a given range. 


an P. Guilford, Fundamental Statistics in Psychology and Education 
(first edition New York and London: McGraw-Hill Book Company, Inc., 1942), 
p. 219) 


Seen 





IIlI. ASSUMPTIONS 

The acceptance of standard statistical methods of computing correla- 

tion coefficients, confidence limits and lines of regression is assumed. 
IV. LIMITATIONS 

This study is limited to the analysis of course grades through the 
first three terms of the four term 1963-1964 Management Curriculum be- 
cause of time limitations. Historically the grades during the third and 
fourth terms have been higher than those of the first and second terms 
and this trend is in evidence at the end of the third term. Therefore, 
it is expected that the final QPR's will be somewhat higher than those 
reported in this paper. 

The practice of alphabetical grade assignment provides 4 comparative- 
ly coarse indication of student performance. For instence, there is far 
less difference between A- and B+ levels of performance than between A+ 
and B- levels of performance, yet the grade assignment would be A and B 
in both instances. This results in some distortion in the QPRs generated. 

V. RESEARCH SIGNIFICANCE 

This study differs from the three which were done previously in that 
it attempts to determine if there exist any significant correlations be- 
tween academic performance and interests or personality characteristics 


of Management Curriculum students. 





CHAPTER II 
DESCRIPTION OF INSTRUMENTS 
I. GRADUATE RECORD EXAMINATION-GRE (APTITUDE) 

This test is prepared by the Educational Testing Service of Prince- 
ton, New Jersey, and is widely used throughout the United States to deter- 
mine student aptitude for postgraduate study. It yields two scores: verbal 
ability and quantitative ability. Included in the test are verbal reason- 
ing questions, reading comprehension questions, and various kinds of mathe- 
matical problems involving arithmetic reasoning, algebra, and the interpre- 
tation of graphs, diagrams, and descriptive data. 

The table of norms for the GRE (Aptitude) indicates that for 3,035 
college seniors the Verbal Ability Test produced a mean score of 492 with 
a standard deviation of 98. The Quantitative Ability Test had a mean score 
of 480 and a standard deviation of 94. Established reliabilities for the 


test are as follows:* 


piveee Reliability 
— Coefficient 
Verbal 90 
Quantitative 84 


*Score Interpretation Handbook 

The GRE is a secure test which is lent to using agencies to be admin- 
istered under controlled conditions. The GRE (Aptitude) requires a total 
working time of 2-1/2 hours. All Management Curriculum students completed 
the aptitude section of the GRE the week prior to the beginning of the 


School year. 








II. STRUCTURED-OBJECTIVE RORSCHACH TEST-SORT 

This is a personality test prepared by the California Test Bureau of 
Los Angeles, California. The SORT is similar to the traditional unstructur- 
ed Rorschach projective ink blot test in that: (1) the ten original stimul- 
us blots are used; and (2) the same scoring system of area, determinants, and 
content is employed. However it differs from the traditional Rorschach in 
that: (1) it is not intended for clinical use but rather as an instrument 
for assessing temperament tendencies or personality traits; (2) the stimulus 
responses are provided to the examinee, making the element of suggestion of 
response an integral part of the test; (3) the total number of responses is 
fixed, permitting stencil scoring of the answer sheets; and (4) no inquiry 
of examinee responses is conducted, obviating the need for a trained psychol- 
ogist. 

The scores are obtained from items grouped together in triads to which 
the examinee responds by choosing the one item of the triad which he per- 
ceives to be representative of the ink blot or some part of the blot. The 
scores obtained from the SORT are grouped according to standard Rorschach 
scoring techniques. The test produces 15 basic scores which are grouped 
into four classes as follows: | 

RORSCHACH VARIABLE SCORES 
Responses to Blot Area 

(1) whole blot (W) 

(2) major blot details (D) 

(3) minor blot details (Dd) 


(4) white space (S) 





Determinant Factors 

(5) responses closely resembling the form of the stimulus (F) 

(6) responses poorly resembling the form of the stimulus (F-) 

(7) responses involving human movement or posture-tension (M) 

(8) responses involving animal movement or posture-tension (FM) 

(9) responses involving color and closely resembling the form of the 

stimulus (FC) 

(10) responses involving color and poorly resembling the form of the 

stimulus (CF) 

(11) responses involving textural density of gray or shading (Fch) 
Content Factors 

(12) responses involving whole animals or parts of animals (A) 

(13) responses involving total human figure or parts of humans (H) 
Statistically Derived Scores 

(14) modal responses (P) 

(15) rare responses (0) 

From these 15 scores, an assessment of 24 different personality traits 
is derived. A description of the personality traits, which the test pur- 
ports to measure, was taken from the test Panuanl and is included as Ap- 
pendix C, 

The population on which the SORT norms are based numbers 8,061 adults. 
Two test-retest studies of the reliability of the 15 variable scores are 
reported in the test manual. The subjects for these studies were 79 col- 


lege students and 94 industrial supervisors; the time between administrations 


srrodee B. Stone, S-O Rorschach Test Manual (preliminary edition; Los 
Angeles: California Test Bureau, 1958, pp. 15-16.) 





was one week. The resulting reliability coefficients were as follows: 


Subjects Reliability Median 
Coefficient Range 


for 15 Scores 
College Students (N = 79) ~62 to .90 wo 
Industrial Supervisors (N=94) .61 to .84 176 

The test manual reports three concurrent validity studies of the SORT 
involving more than 4,000 individuals. The 15 scores were variously found 
to yield meaningful correlations with industrial employee ratings and with 
grade point averages of college freshmen, In one study involving 70 sub- 
jects, the supervisory ratings and SORT scores were found to be within nine 
points of agreement on a 100 point scale, 71 percent of the time. 

The SORT takes approximately 30 minutes to administer. It was given 
to All Management Curriculum students during a regularly scheduled class 
period during the third term. 

III, AVL-STUDY OF VALUES 

This is a personality or interest test distributed by the Houghlin 
Mifflin Company of Boston, Massachusetts. It is designed to measure the 
relative prominence of six basic interests or motives in personality: 
theoretical, economic, aesthetic, social, political, and religious. The 
classification is based directly upon Edward Spanger’s Types of oe A 
more complete description of those attributes which the test purports to 
measure is included in Appendix D. 

The test consists of a number of questions based on a variety of 


familiar situations to which alternative answers are provided. The examinee 


a Spanger, Types of Men, translated by Paul J. W. Pigors in Lebens- 
formen (New York: Stechert-Hafuer, Inc., date unknown). 





records his preferences numerically and the results are added to deter- 
mine his relative interest in the six values. 

One split-half reliability test of sample size 100 and two test-re- 
test reliability tests of sample sizes 34 and 53 are reported in the test 


manual with the following results: 


Test | Reliability Coefficient Mean 
Range for Six Values 

Split-Halves (N = 100) .84 to .95 90 

Test-Retest (1 Mo. interval, N = 34) sid alO ok .89 


Test-Retest (2 Mo. interval, N 53) 84 to .93 88 

The test is essentially self-administering and requires about 20 
minutes to complete. Of the five Management Curriculum sections, three 
completed the test during regularly scheduled class periods and the other 
two sections completed it outside of class. 

IV. LOCAL QUESTIONNATRE 

This is an eight question multiple choice questionnaire which was de- 
signed by the authors of this paper. A copy of the questions along with a 
bar graph of the results is included in Appendix E. An attempt was made to 
Structure the questionnaire so that the answers progressed from the higher 
to the lower motivational level; i.e., the first answer is intended to in- 


dicate the highest student motivation and the last answer the lowest student 


motivation for the Management Curriculum. 


gcondon W. Allport, Phillip E. Vernon, and Gardner Lindzey, Study of 
Values-Manual, Boston: Houghlin Mifflin Company, (1960), pp. 4-5. 





CHAPTER III 
METHODS, TECHNIQUES, AND PROCEDURES 
I. GENERAL 
All 99 officer students of the 1964 Management Curriculum constituted 

the respondents for this study. The pertinent characteristics of the 
members of the class are listed in Table I. There were no significant 
differences between the constitution of the 1962, 1963, and 1964 Manage- 
ment classes. 

TABLE I 


MANAGEMENT CURRICULUM STUDENT RANKS, DESIGNATORS, AND MILITARY COMPONENTS 


Rank/Designator CDR/LCOL LCDR LT TOTAL 
Line (1100) 13 HZ 10 35 
Line (1310-1350) 11 11 3 25 
Aviation 
Line (1510-1515) 2 2 
(WEDO) 
Line (1610) 1 } 
Communications 
Supply (3100) 5 14 3 Da 
CEC (5100) 1 1 3 5 
MSC (2300) 4 4 
USMC 1 1 
USCG - ms mi 4 
a2 43 24 99 


The basic data used in the study includes the scores obtained from 


academic grades and the aptitude and personality tests previously described, 
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The academic grades, QPRs, and GRE and personality test scores are 
listed in Appendixes A and B opposite student identification numbers 
which were assigned to preserve anonymity. The data listed in Appendixes 
A and B was punched onto IBM cards for each student, and by means of a 
computer program this data was used to generate correlation coefficients. 
Prediction data was calculated by means of regression analysis and plotting 
of scatter diagrams. 
II, CORRELATION ANALYSIS 

The data listed in Appendixes A and B was punched onto IBM cards, 
one for each student, as follows: 

QPR Total Score 

GRE Average Score 

GRE Verbal Score 

GRE Quantitative Score 

15 Rorschach Variable Scores as listed in Chapter I[I.* 

6 Study of Values Scores as listed in Appendix D. 
* All Rorschach scores used were raw data scores. 

Statistical comparison of this data was achieved through the Product- 


Moment Method of linear en as follows: 


= ae Correlation between X and ~~ 
\y~ 
Cy Dy 


p = Z oO Y) Si X €(y) = Product Moment 
Al A/f 


Q = Standard Deviation 


Where: 


X = Test Score 


enredaewer Cecil Mills, Statistical Methods Applied to Economics and 
Business (New York: H. Holt and Company, 1938), p. 368. 





| 





¥ 
N 


QPR Score 


99 (Sample Size) 


Arithmetic relationships were programmed for the 1604 Control Data 
Corporation computer and the desired correlation coefficients, means, 
variances, and standard deviations thus obtained. 

ITI. CONFIDENCE LIMITS 
Confidence limits for the coefficient of correlation of the GRE (A) 


to QPR were computed from the formula: 


~ f- * 
Ga er 


Where: VN a if 


= Correlation coefficient 


Sample size (99) 


Standard error of \|V 


falas ae 


IV. REGRESSION ANALYSIS 
Lines of regression and associated standard errors were computed for 
the purpose of prediction of academic performance based on GRE scores. 
The lines of regression and associated standard errors were computed from 
the following formulas: 


Line of ~— 
Ree re sain - Yory Ory _ pp & xX + ¥ 





Standard Error — 
about Line - Sy = Jy VV / -/ a 


Of Regression 


Where: 
Predicted QPR based on test score X 


ine 
tl 


Correlation coefficient GRE (A) to QPR (.6253) 


x) 4 


Standard deviation of QPRs (.5464) 
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Standard deviation of GRE (A)s 


Mean GRE (A) 


Mean QPR (third term) 


13 


(73.306) 
(568.990) 


(1.950) 





CHAPTER IV 
RESULTS OF THE STUDY 
I, GENERAL 

As stated initially, this study had two primary purposes, The first 
was simply to assess the nature of the student population in the Manage- 
ment Curriculum by administering the various personality and aptitude 
tests described previously. The second (and more practical) objective 
was to determine whether or not any of the test results could serve as 
useful predictors of academic success in the Management Curriculum. The 
results presented in this chapter are organized along the lines of these 
objectives, First, test results for each test are discussed independently 
from results on other tests. In the second portion of the chapter, corre- 
lations between test results and student performance is discussed. A 
summary of means and standard deviations for all variables considered is 
provided at the end of the chapter in Table xX, 

II. TEST AND QUESTIONNAIRE RESULTS 
GRADUATE RECORD EXAMINATION - (GRE) 

Table II provides a comparison of mean scores achieved on the two 
sections of the GRE (verbal section and eens section) by Manage- 
ment students from 1962 through 1964. Information regarding national 
norms is also included for purposes of comparison. 

The data in Table II indicates that the mean GRE scores of the last 
three Management classes have been approximately equal. In addition, it 
indicates that Management students score significantly above national 
norms for college seniors on both the verbal and quantitative portions of 
the GRE. 
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TABLE [Tf 


Mean Scores on GRE 


Sample National Norm** 1962 1963 1964 
Sample Size Large 94 94 99 
Test 
GRE (Average)* 49.4 56.2 55.10 55.9 
GRE (Verbal) 48.7 52.6 51.7 54.5 
GRE (Quantitative 50.0 Dead 59.5 Fores 


* 1/2 (GRE (V) & GRE (Q)) 
*kScore Interpretation Leaflet for Students, Educetional Testing Service, 
Princeton, New Jersey. 


STRUCTURED OBJECTIVE RORSCHACH TEST - (SORT) 

Results of the SORT are given in Tables III and IV. 

Table III is a distribution of how the naval officers in the sample 
scored on each of the 24 personality traits measured by the SORT. This 
table permits comparison of the sample with the normative population of 
the SORT which consisted of over 8000 adults drawn from diverse occupa- 
ene” 

The classifications of High, Above Average, Average, etc., were defined 
such that the following percentages of the normative population fell into 


each group: 


High 7% 
Above Average 23% 
Average 407, 
Below Average 237 
Low 7h 


Since the naval officer sample size was 939, the number of officers 


scoring in each category (High, Low, etc.) approximates the percentage 


yeiic B. Stone, op.cit., pp. 4-10. 
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in that category. This percentage can then be compared with the normal 
population percentages listed above. For example, the trait entitled 
Theoretical shows that nine of the 99 officers scored high, 31 above 
average, etc. 

TABLE IIL 


Distribution of Scores on 24 SORT Personality Traits 


n= 99 
Above Below 
High Average Average Average Low 
Normal Percent 7% 23% 407, Lo a 
TRAITS* 
Theoretical 9 31 39 19 1 
Practical 1 14 62 19 3 
Pedantic 2 19 40 34 4 
Induction 13 30 36 19 l 
Deduction 3 20 61 a2 5 
Rigidity 3 43 42 10 1 
Structuring 24 34 31 6 4 
Concentration 11 30 2 6 0 
Range 2 25 54 18 0 
Human Relationships 4 28 38 ZF 2 
Popular 4 18 49 Ze 6 
Original 1 4 21 53 20 
Persistence 3 43 42 10 1 
Aggressiveness 16 40 34 8 1 
Social Responsibility 3 23 59 12 2 
Cooperation l 10 61 26 L 
Tact 0 11 67 21 0 
Confidence 5 20 46 23 5 
Consistency-Behavior 17 44 31 7 0 
Anxiety 4 18 47 24 6 
Moodiness 0 12 54 26 7 
Impulsiveness 0 6 54 27 12 
Flexibility 3 39 54 5 0 
Conformity 13 40 34 10 2 


*A more detailed description of each personality trait measured by the 
SORT is contained in Appendix C. 
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Analysis of the figures in Table [II reveals chat the naval officers 
in the sample scored high in Induction, Structuring, Concentration, Aggres-~- 
siveness, Consistency of Behavior and Conformity. Low scores were in evi- 
dence for Impulsiveness , Moodiness and Original kesponse. 

Table IV lists each scoring variable in the SORT and shows the mean 
score obtained by the naval officers in the sample, and mean scores of 
a large diverse group of adults, and of several selected occupational 
groups. The occupational groups selected are Industrial Supervisors, 
Industrial Workers, and Salesmen. 

TABLE IV 


Mean Scores on 15 SORT Scoring Variables 





Composite* Naval Industrial* Industrial* 
Variable Population Officers Supervisors Workers Salesmen* 
Sample Size n = 5024 n= 99 n = 539 n = 1412 n = 140 
W 31.85 36.62 36.00 30.41 52055 
D 53.66 54.53 54.14 See 54.20 
Dd 12.80 11.68 9.64 13.62 12.35 
S 12.41 Lope 12.41 12.17 11.900 
F ZO 29.42 30.32 27.38 26.00 
F- 13332 11.40 10.64 14.65 12225 
M 8.61 9.55 9.09 8.54 7.83 
FM 10.54 11.17 11.26 10.59 9.88 
FC 12.72 13251 L255 11.41 2.75 
CF 149) 68.69 7.14 8.49 &.75 
Fch 16.54 17.81 15.00 16.41 18.68 
A 35cgho 32.81 S125 34.76 27.98 
H 21.92 21.14 24.60 Zi eo2 19.98 
P 57 e195 D7 eo 57.91 57.84 44.55 
0 5.03 5.92 4,37 Bley 4.43 


*Data for all columns except naval officers obtained from SORT Test Manual. 


A comparison of the scores in Table IV indicates that the average 


response of the 99 naval officers corresponds quite closely with the average 


response of industrial supervisors. 


For example, both naval officers and 


industrial supervisors are significantly above the composite average in 





whole blot (W) responses, Form (F), and Form Movement (FM) responses. 

On the other hand, both groups are below average in categories for Small 
Detail (Dd), Poor Form (F-) and Poor Form-Color (CF). Similar compari- 
sons with the other occupational groups show that naval officer responses 
differ markedly from those of industrial workers and salesmen, 

The comparison of the naval officer sample with other occupational 
groups is not in itself particularly useful. This comparison does give 
considerable insight into the operation of the SORT, however, and provides 
a better basis for interpreting scores. Common sense would probably lead 
one to believe that in their jobs, naval officers are more akin to indus- 
trial supervisors than to either industrial workers or salesmen. Test 
results which coincide with this assessment indicate that the SORT is 
capable of separating people into groups with meaningful characteristics 
from a practical viewpoint. This comparison also points up the possibility 
of using the SORT as a vocational guidance and/or selection tool. 

The comparison with the industrial supervisor group tends to temper 
the results of Table III regarding naval officers. When compared with 
supervisors, the high naval officer scores for Aggressiveness, Structured 
Thought, Conformity, etc., do not seem particularly extreme. Apparently 
there is some tendency for college graduates to exhibit these character- 
istics, and a strong tendency for people in supervisory positions to ex- 
hibit them. 

ALLPORT-VERNON-LINDZEY STUDY OF VALUES (AVL) 

Results of the AVL - Study of Values are given in Tables V and VI. 
Table V is similar to Table III for the SORT wherein each interest area 
is listed and naval officer responses classified into categories of High, 


Low, etc. Normal population percentages which are listed are different 


18 





from those in Table III however. 
TABLE V 


Distribution of Naval Officer Response to AVL 
Study of Values Interest Areas 


n = 99 
Above Below 
High Average Average Average Low 

Normal Percentage 9% 16% 50% 16% 9% 
INTEREST AREAS 

Theoretical 2 11 60 20 6 

Economic 14 25 46 10 4 

Aesthetic 7 16 44 20 Fi 

Social 5 5 4S 24 20 

Political 19 31 34 11 4 

Religious 6 16 53 14 10 


Comparative mean scores for the naval officer sample, college males 
and a group of Air Force officers are listed in Table VI. 
TABLE VI 
Comparative Mean Scores on AVL Study of Values 


Naval Officers College Males* Air Force Officers* 
Sample Size ni 99 n 5,894 = 61 





INTEREST AREAS 


Theoretical 42.19 43.09 42.72 
Economic 45.90 42.05 43.02 
Aesthetic Bae 86.72 35.12 
Social S302 37.05 35.54 
Political 46.52 ag.22 46. 34 
Religious 37.08 37.88 37.26 


*Data obtained from Allport-Vernon-Lindzey Study of Values Manual. 
Houghlin Mifflin Company, Boston. 


The results in Tables V and VI do not reveal any marked differences 
between naval officers in the sample and the normative population. It 
should be noted that the AVL was standardized on a group of college 
students, however, so more homcgeneity might be anticipated than in the 


case of the SORT which was standardized on a more diverse population. 
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There does appear to be some tendency for naval officers to score 
high on the Political and Economic scales and low on the socis' scale, 
(A description of interest area titles is contained in Appendix BD.) fit 
is also interesting to note the close correspondence between mean scores 
for naval officers and the sample of 61 Air Force officers. 

LOCAL QUESTIONNATRE 

At the end of the first and second terms of the Management course 
the student QPRs were somewhat lower than those of previous years, In 
seeking the reason for the lower performance the question of student motiwva- 
tion arose. Consequently, the local questionnaire was promulgated during 
the third term to obtain a subjective indication of the interest of the 
Management students in the curriculum. 

The results obtained from the local questionnaires of 98 students are 
depicted on bar graphs in Appendix E. The bar graphs illustrate the fol- 
lowing: 


Graph E-1 88 Students requested assignment to the Management Curriculum 
as first or lesser choice. 


Graph E-2 54 Students found the course at least fairly close to what 
they expected. 


Graph E-3 57 Students were highly elated to receive orders to the 
Management Curriculum and only one was disappointed. 


Graph E-4 65 Students probably or definitely would have chosen to re- 
main in the Management Curriculum if they had been given 
the option of reassignment at the end of the first term, 


Graph E-5 At receipt of orders to the Management Curriculum 80 students 
considered that completion would enhance their promotion 
potential. 


Graph E-6 At the time of completion of the local questionnaire only 51 


students considered that assignment to the Management Cur- 
riculum had enhanced their promotion potential. 
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Graph E-7 At receipt of orders to the Management Curriculum 82 
students considered that completion would greatly enhance 
their "on the job" performance in the future. 

Graph E-8 At completion of the local questionnaire only 65 students 
considered that assignment to the Management Curriculum 
would greatly benefit their "on the job" performance in 
the future. 

From these results it appears that the motivation of the current 
students is generally good. From the shift in distributions between graphs 
E-5 and E-6 and between E-7 and E-8 it may be inferred that there was a 
reduction in motivation between order receipt and local questionnaire comple- 
tion. 

III. CORRELATION ANALYSIS 
Table Villists correlation coefficients for all] test score variables 


against the third term QPR. (A complete intercorrelation table of all 


variables included in the study is included at the end of the chapter in 


Table XI.) 
TABLE VII 
Coefficients of Linear Correlation Between 24 
Test Scores and Third Term QPRs 
Coeit. of Coeff. of 

Test Score Correlation Test Score Correlation 
GRE (A) 1625 SORT CF 060 
GRE (V) 453 Fch -.095 
GRE (Q) Ae . A -, 161 
SORT W -.215 i H .040 
: D 190 : P = 7039 
: Dd 060 a 0 056 
S . 104 AVN T 184 
a F ,104 . E -.140 
5 F- -.097 _ A 156 
ie M wo) . S -,061 
_ FM -.074 - P -.214 
: FC -.052 o R 073 


As mentioned previously, a correlation coefficient of approximately 


a 


.45 or higher is considered necessary if test scores are to be useful 
for predictive eee The Graduate Record Exams are the only test scores 
with correlation coefficients over .45. It does not appear chat scores 
on SORT or AVL factors are by themselves useful for predicting academic 
success in the Management Curriculum. 
CONFIDENCE LIMITS 

The 95% confidence limits on correlation coefficients of the GRE 

scores against third term QPR's are as follows: 
TABLE VIII 


Confidence Limits GRE/QPR Correlation Coefficients 


Correlation 95% Confidence Range of 

Test Coefficient Limit Limits 
GRE (Verbal) ~4529 + .1574 -6103---.3955 
GRE (Quantitative) ro D24 + .1376 -6900---.4148 
6253 + 1206 »7459---,5047 





In view of the confidence limits in Table VIIY, there can be little 
doubt but that the GRE score is an excellent predictor of academic success 
in the Management Curriculum. 

REGRESSION ANALYSIS 

Having established the GRE as a good predictor of academic success, 
a line of regression with associated standard error was computed in 
accordance with the procedure described in Chapter III. This resulied in 
the following line of regression and standard error about the line: 

Y = 0.00466X - 0.702 
and SY = 0.4264 

Figure 3 page 26 depicts the line of regression of the GRE(A) against 

the QPR. 


oop Pe Gulltord, loc cit. 
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COMPARISON WITH PRIOK YEARS 

In their study of the 1963 Management class, Kauder and Ebert com- 
puted lines of regression for the 1962 and 1963 classes.” These lines 
are reproduced herein (with modification of scale) as Figures 1 and 2. 
(Page 25 ). Kauder and Ebert noted the very marked shift that took 
place in the line of regression between 1962 and 1963. This shift has 
continued and become more pronounced in 1964. Figure 4 (Page26) provides 
a comparison of these lines for the past three years. 

Kauder and Ebert concluded that the 62/63 shift occurred because the 
faculty had raised its grading standards in 1963. There can be little 
doubt but that their conclusion was correct. It is also apparent at this 
time that grading standards were again raised in 1964. As was pointed out 
earlier, the GRE scores of the last three classes have been approximately 
equal and yet the average third term QPR has declined steadily each year. 


Comparative mean third term QPRs are as follows; 


Year Mean QPR 
1962 ~ one 
1963 = Del] 
1964 - 1.95 


It appears that the predictive ability of the GRE is improving as the 
grading standards become more stringent. This is illustrated by the fact 
that the correlation coefficient between the QPR and GRE has increased in 

oeoneee Kauder and Scott W. Ebert, "An Investigation of the Validity of 
Certain Aptitude Tests in Predicting Academic Performance in the Navy Manage- 
ment Curriculum at the United States Naval Postgraduate School", (Unpublish- 


ed Research paper, U. S. Naval Postgraduate School, Monterey, 1963) pp. 26- 
28% 


ZS 


each of the last three years as indicated below: 


Year Correlation Coefficient 


1962 4839 
1963 «5826 
1964 ~6250 


The constantly shifting line of regression makes it difficult to 
establish a cut-off score on the GRE that could be utilized for selection 
of applicants for the Management Curriculum. With such a shifting line it 
is impossible to take a strict statistical approach and predict with confi- 
dence that if a cut-off of some certain score were established, a certain 
percentage of incoming students would attain a QPR of 2.00 or better. 
Despite this difficulty, the authors believe that a low cut-off on the GRE 
(probably around 500) could be used to advantage. For example, had such 4 


cut-off been used in 1963 and 1964, the following would have occurred: 


TABLE IX 
Results of Using a Cut-off Score of 500 on the GRE(A) 

1963 1964 
Students eliminated by 500 cut-off on GRE(A) 25 19% 
Number eliminated with QPR above 2.00 (3rd term) 9 3 
Number eliminated with QPR below 2.00 (3rd term) 16 16% 
% of total class below 2.00 before cut 327 ae fs 
% of total class below 2.00 after cut 077% 417%, 


*Includes 2 students who dropped out of school prior to the 3rd term, 

As may be noted from Table IX, a cut-off of 500 on the GRE (A) would 
have resulted in dramatic improvement in 1963 academic achievement but also 
would have eliminated 9 students with QPRs over 2.00. In 1964 only 3 
students over 2.00 would have been eliminated, but having 41% of the class 


still remaining below 2.00 is an unsatisfactory condition. Nevertheless, 
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replacing 16 officers with QPRs below 2.00 by 16 other selectees with 
much higher probability of achieving a satisfactory QPR wovld still seem 
to be a highly desirable outcome. 

TABLE X 


Summary of Means and Standard Deviations 
of All Variables Included in the Study 


n= 99 
Variable Mean Standard Deviation 
QPR (3rd term) beoS 0.55 
GRE (Average) 56.90 teas 
GRE (Verbal ) 54.53 G./5 
GRE (Quantitative) 59.33 5.45 
SORT W 33°35 5.51 
- D 54.53 4.46 
. Dd 11.68 3.10 
" S 13232 2.55 
i F 29,42 5.50 
o E- 11.40 sae 
. M 9.55 Jee 
- FM Lia 2.00 
: FC M350 2a 
- CF 6.87 2.19 
_ FCh 17.81 4,21 
” A 32.81 4.39 
a H 21.14 4,34 
a P 57.15 6.48 
Mt O aoe 2.81 
AVL T 42.19 Sood 
_ E 45.90 7.93 
, A 34,52 &.07 
S 33.66 7.99 
e P 46.52 7.24 
= R 37.08 8.54 
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Study 


TABLE XI 


Intercorrelation Coefficients for All Variables Included in tne 
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CHAPTER V 
CONCLUSIONS AND RECOMMENDATIONS 
I, CONCLUSIONS 

A. The Graduate Record Exam is an excellent predictor of academic 
performance in the Management Curriculum. This conclusion has held for 
three successive classes under various grading standards. 

B. The higher the grading standards, the greater the predictive 
ability of the GRE. 

C. Neither the SORT nor AVL Study of Values are by themselves use- 
ful predictors of academic success in the Management Curriculum. the 
possibility of combining scores on these tests in various combinations 
or with the GRE to obtain higher correlation than with the GRE alone was 
not investigated. 

II, RECOMMENDATIONS 

It is recommended that: 

A. The GRE be administered to the candidates for the Management 
Curriculum, 

B. Selection Boards be informed of candidate S*scores on the GRE and 
be advised that applicants with an average GRE score of less than 500 have 


a low probability of successfully completing the curriculum, 
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PERSONALITY TRAITS WHICH THE STRUCTURED OBJECTIVE 
RORSCHACH TEST (SORT) SEEKS TO MEASURE 


General: Scores in Mental Functioning and Temperament factors are expres- 
sions of the degree of the factor relative to scores generally distributed 
in the population. That is, high scores and those above average do not 
imply a degree that is "good,"' "bad," "healthy,'' or “advantageous." A high 
score simply indicates that the examinee has made more responses than the 
typical individual to a particular variable. The evaluative interpretation 
(high or low) depends upon the nature of the factor and its contribution to 
the individual's life. 


MENTAL FUNCTIONING 

Intellectual level does not necessarily reflect intellectual performance. 
It is desirable to know such features as the type of approach to inteliec- 
tual situations used, adaptability to the reasoning processes, flexibiiit 
of ideas, and ability to organize (structure) mental processes. 


Theoretical (W): Facility for thinking in broad, general, or abstract 
terms; facility for getting perspective, visualizing the overall picture, 
and seeing relationships between the parts. 


Practical (D): Tendency for thinking or attacking problems on the basis 
of practical, concrete, or very definite details. 


Pedantic (Dd): Preference for thinking and attacking problems from the 
standpoint of fine, minute details; tendency to be perfectionistic and to 
focus on precise, sometimes trivial details. 


Induction (W:M): Facility for logical thinking based upon inferences 
from elements; utilization of their accumulative synthesis to lead to ccn- 
clusions, principles, or generalizations; ability to organize details into 
a meaningful whole. 


Deduction (D:M): Readiness to employ the logical approach in which 
established or speculative theories, principles, or generalizations are 
applied to data or details for the purpose of analyzing their relation- 
ships to one another (and to the principle probably involved). A balance 
between facilities for inductive and deductive thinking, especially when 
both are high, would point toward a mental adaptiveness or "efficiency" 
wherein such intellectual potential as the individual has is the more ef- 
fective because of versatility in logical processes, 


Rigidity (S): Tendency toward the dogmatic or toward fixed ideas, 
Higher scores suggest an unwillingness to change a point of view in spite 
of evidence to the contrary; low scores suggest an uncritical acceptance 
of others' viewpoints. 


Structuring (F): Facility for mental alertness and precision and exact- 


itude in perception of reality. Occasionally this relates to a somewhat 
rigid and formalistic way of solving problems, but usually indicates an 


So 


awareness of and conformity to the environment and its demands. 


Concentration (F-:F): Capacity for attending to the task at hand or 
for avoiding distractions from one's environment or from one’s own extran- 
eous thoughts. 


REDUCTIVES 
Factors that result in lowering intellectual performance below one’s 
mental potential are called Reductives and are listed below, 


Low Generalization (Low W): The Theoretical (W) factor rates so low 
that attention to principles, perspectives, or theoretical implications is 
ameercult. 


Perfectionism (High Dd): The Pedantic (Dd) factor is so extremely high 
that thought is lost in a welter of preoccupation with minutiae. 


Poor Control (High F-): The preponderance of "F-" in the Concentra- 
tion factor is such that thought is not channeled readily into effective 
processes, 


High Anxiety (High Fch): The Anxiety (Fch) factor is so high that 
acceptance of one's own conclusions is difficult; as a result, the ability 
to "think a thing through" is impaired. Excessive worry and feelings of 
insecurity or incapacity may be dominant. 


Compulsivity (High S, F, and D): A combination of the Structuring (F), 
Rigidity (S), and Pedantic (Dd) factors is of such magnitude that needless 
repetition, excessive exactness, and unreal conformity result in preventing 
the full mental processes from proceeding to a logical conclusion. 


PNPFERESTS 

These facets of behavior refer to the range of reactions to perceptual 
experience. Sensitivity to a variety of kinds of percepts implies a broad- 
er range of interests than does a paucity of percept-types. 


Range (H:P::A): Tendency of interest to be either expansive or to be 
narrow and confined. 


Human Relationships (H): Disposition toward the perception of and 
attention to elements having human connotations. 


RESPONSIVENESS 

Two frames of reference are involved here. The first derives from the 
modality of responses, the second from the frequency of responses, [t is 
assumed that responses to items most frequently seen by the majority of 
the normative group are indicative of conformity. Conversely, consistent 
selection of rarely observed items implies a disposition toward uniqueness. 


Popular (P): Tendency to perceive the same features in the same way 
as others; to see things as other persons do; empathic tendencies. | 
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Original (0): Disposition to perceive the unique, the different, and 
the non-conforming, perhaps even the eccentric; emphasis on individualism , 


of actions. 


TEMPERAMENT 

The attributes listed under this heading relate largely to deep inner 
feeling, for which there often are compensations in outwardly observed be- 
havior. Many of the compensations can become occupational advantages. 


Persistence (S): The determination not to deviate from a set course, 
It may appear as doggedness or stick-to-itiveness, [t can range from in- 
ability to stick to or complete a task along to the further extreme of 
stubborness, defiance, or contentiousness. 


Aggressiveness (F:M): The aspiration toward goals by means of well- 
accepted and morally developed procedures; willingness and desire to work; 
sense of a mature self-control with social conformity. 


Social Responsibility (FC:M): Willingness to subserve oneself, even 
though no personal gains are evident; energetic acceptance of one's obli- 
gations to himself, to his family, and to society. 


Cooperation (CF:FC): Willingness to use a teamwork approach; sensi- 
tivity toward others in combination with appreciation and responsiveness 
in human relationships. Willingness to submerge one’s immediate needs to 
the long-range interests of other persons is implied. 


Tact (FM:FC:M): Control of impulses and biases; maturity expressed in 
the ability to maintain a stable relationship with superiors, peers, and in- 
feriors. There is balance between inner impulses, conscious self-control, 
and demands of the social environment. 


Confidence (FM:M): Ego-strength, self-confidence, morale; inner feel- 
ings of inferiority to strong feelings of self-assurance. It implies 
ability to withstand stresses and strains and to maintain feelings of self- 
worth (prestige) in the face of adversity. 


Consistency of Behavior (F::S:Fch): Predictability of actions; tendency 
for characteristic behavior patterns to be stable and well established, 


Anxiety (Fch): Generalized apprehensiveness, uneasiness, or internal 
disquietude; self-concern and preoccupation with personal well-being, feel- 
ings, emotions, and sensations, resulting from a feeling of insecurity. 

A low anxiety score indicates composure; however, excessive composure, or 
almost complete absence of anxiety, may indicate a tendency to smother 
feelings to the point of seeming cold and insensitive. Anxiety may re- 
fFlect itself in feelings of insecurity, expressions of inadequacy, or con-~ 
striction of behavior; it may also reflect itself in erratic behavior. 


Moodiness (F-:FM::F:M): Sharp fluctuations in mood, ranging from ela- 


tion to depression. The intensity and duration of either phase may vary 
greatly. 
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Activity Potential (M): Control of emotional energy; energy endowment ; 
capacity to follow through on a planned course of action; concentration of 
energies in a given direction, as opposed to dissipation of strength in 
non-productive channels. 


Impulsiveness (F-:F): Tendency to act upon impulse rather than on the 
basis of a considered plan; reflected in spur-of-the-moment decisions. 


Flexibility (M::FC:CF): Adaptability; faculty for accepting and hand- 


ling most life situations in a mature manner; capacity to adjust readily 
from one type of situation to another. 


Conformity (0:P): Tendency to accept and be directed by the socially 
accepted codes, customs, and mores. 
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SIX BASIC INTERESTS OR MOTIVES IN PERSONALITY 
WHICH THE "STUDY OF VALUES" SEEKS TO MEASURE 


1. The Theoretical. The dominant interest of the theoretical man is the 
discovery of truth. In the pursuit of this goal he characteristically 

takes a "cognitive" attitude, one that looks for identities and differences, 
one that divests itself of judgments regarding the beauty or utility of 
objects, and seeks only to observe and to reason. Since the interests of 
the theoretical man are empirical, critical, and rational, he is necessarily 
an intellectualist, frequently a scientist or philosopher. His chief aim in 
life is to order and systematize his knowledge. 


2. The Economic. The economic man is characteristically interested in 
what is useful. Based originally upon the satisfaction of bodily needs 
(self-preservation), the interest in utilities develops to embrace the 
practical affairs of the business world -- the production, marketing, and 
consumption of goods, the elaboration of credit, and the accumulation of 
tangible wealth. This type is thoroughly "practical" and conforms well to 
the prevailing stereotype of the average American businessman, 


The economic attitude frequently comes into conflict with other values. 
The economic man wants education to be practical, and regards unapplied 
knowledge as waste. Great feats of engineering and application result from 
the demands economic men make upon science. The value of utility likewise 
conflicts with the aesthetic value, except when art serves commercial ends, 
In his personal life the economic man is likely to confuse luxury with 
beauty. In his relations with people he is more likely to be interested 
in surpassing them in wealth than in dominating them (political attitude) 
or in serving them (social attitude). In some cases the economic man may 
be said to make his religion the worshir of Mammon, In other instances, 
however, he may have regard for the traditional God, but inclines to 
consider Him as the giver of good gifts, of wealth,prosperity, ance other 
tangible blessings. 


3. The Aesthetic. The aesthetic man sees his highest value in form and 
harmony. Each single experience is judged from the standpoint of grace, 
Symmetry, or fitness. He regards life as a procession of events; each 
single impression is enjoyed for its own sake. He need not be a creative 
artist, nor need he be effete; he is aesthetic if he but finds his chief 
interest in the artistic episodes of life. 


The aesthetic attitude is, in a sense, diametrically opposed to the 
theoretical; the former is concerned with the diversity, and the latter 
with the identities of experience. The aesthetic man either chooses, with 
Keats, to consider truth as equivalent to beauty, or agrees with Mencken, 
that "to make a thing charming is a million times more important than to 
make it true.'' In the economic sphere the aesthete sees the process of 
manufacturing, advertising, and trade as a wholesale destruction of the 
values most important to him. In social affairs he may be said to be 
interested in persons but not in the welfare of persons; he tends toward 
individualism and self-sufficiency. Aesthetic people often like the 
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beautiful insignia of pomp and power, but oppose political activity when 
it makes for the repression of individuality. In the field of religion they 
are likely to confuse beauty with purer religious experience, 


4. The Social. The highest value for this type is love of people. In 

the "Study of Values" it is the altruistic or philanthropic aspect of love 
that is measured. The social man prizes other persons as ends, and is 
therefore himself kind, sympathetic, and unselfish. He is likely to find 
the theoretical, economic, and aesthetic attitudes cold and inhuman. In 
contrast to the political type, the social man regards love as itself the 
only suitable form of human relationship. Spranger adds that in its pur- 
est form the social interest is selfless and tends to approach very closely 
to the religious attitude. 


5. The Political. The political man is interested primarily in power. His 
activities are not necessarily within the narrow field of politics; but 
whatever his vocation, he betrays himself as a Machtmensch, Leaders in any 
field generally have high power value. Since competition and struggle play 
a large part in all life, many philosophers have seen power as the most 
universal and most fundamental of motives. There are, however, certain 
personalities in whom the desire for a direct expression of this motive is 
uppermost, who wish above all else for personal power, influence, and 
renown, 


6. The Religious. The highest value of the religious man may be called 
unity. He is mystical, and seeks to comprehend the cosmos as a who's, to 
relate himself to its embracing totality. Spranger defines the r. ligious 
man as on "whose mental structure is permanently directed to the creation 
of the highest and absolutely satisfying value experience."’ Some men of 
this type are "immanent mystics," that is, they find their religious experi- 
ence in the affirmation of life and in active participation therein. A Faust 
with his zest and enthusiasm sees something divine in every event. The 
“transcendental mystic,'' on the other hand, seeks to unite himself with a 
higher reality by withdrawing from life; he is the aescetic, and, like the 
holy men of India, finds the experience of unity through self-denial and 
meditation. In many individuals the negation and affirmation of life 
alternate to yield the greatest satisfaction. 
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Questions 


Qe 1. Did you request assignment to Mgmt Postgraduate School? 


(1) Yes, as first choice on data card and in addition I con- 
tacted my detailer to urge assignment to the Schools 

(2) Yes, as first choice on data card. 

(3) Yes, as second or lower choice on data carde 

(4) No 

(5) No, and I made a specific attempt not to be assigned. 
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(1) (2) (3) (4) (5) 
Questions 


Qe 2. Does the course content of the Mgmt curriculum correspond to 
what you expected at the time you requested assignment? 


(1) Course content is very close to what I expected. 

(2) Course content is fairly close to what I expected. 

(3) Content is considerably different from what I expectede 
(4) Course content is not at all what I expected. 

(5) I didn't know anything about the course when I requested 


assignmente 
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Qe 3. Were you pleased to receive orders 
to Management School? 


Highly Elated / / / / / / Disappointed 
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(2) (3) (4) (5) 


Questions 


Qe 4. If you were given the option at the end of the first term of 
continuing in the Memt curriculum or of being reassigned: 


(1) 
(2) 
(3) 
(4) 
(S) 


I would definitely choose to remain in school. 

I woule probably choose to remain in Mgmt School. 
I would have been indiferent as to the choice. 

I would probably choose to be reassigned. 

I would definitely choose to be reassigned. 
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Questions 


Q. S- At the time you received orders to Menagement School, did you 
feel that completion of the school would enhance your promo= 
tion potential or be a detriment? 


Greatly Enhance / / / / / / Be Detrimental 
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Questions 


Q. 6. At this time do you feel that assignment to the Mgmt School 
has enhanced your promotion potential or has been detrimental? 


Greatly Enhanced / / / / / / Been Detrimental 
12345 
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2) (2) (5) 
Questions 
Q. 7. At the time you received orders to Mgmt School did you feel 


that completion would benefit your "on the job" performance 
in future duty assignments? 


Re of Great Benefit / / / / / / Be of Very 
12345 #£Little Value 
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(1) (2) (3) (4) SS) 
Questions 


Q. 8 At this time do you feel that attendence at Management School 
will benefit your “on the job" performance in future duty 
assignments? 


Be of Great Benefit / / / / /_/ Be of Very 
12345 #£xLittle Value 
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